Profile picture for user masaki.yamakawa
Masaki
Yamakawa
Managing consultant
at
UL Systems, Inc.
Masaki Yamakawa is an IT consultant at UL Systems, Inc. He specializes in distributed system and in-memory computing, and makes the best use of various technologies to resolve problems related to enterprise IT. About 10 years ago, He was responsible for building a scalable distributed system utilizing the in-memory data grid in a securities company. After that He has been building numerous scalable data platforms as an IT architect of distributed systems. In recent years, He has been doing verification and PoC for various distributed system technologies. He is also currently involved in the launch of "Japan Apache Geode User Group" community.
I will introduce the in-memory based big data processing platform seamlessly integrated with Apache Spark. Apache Spark is an excellent distributed computing framework. However, it is necessary to read the data each time it is processed. In addition, it is necessary to write the processing results in some data store. As a result, it takes time to…